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1 .  Introduction 

The  first-  and  second-order  variation  of  the  optimal  value  of  a 
general  nonlinear  program  under  quite  arbitrary  parametric  perturba¬ 
tions  has  been  investigated  by  Hogan  (15],  Arniacost  and  Fiacco  [1,2,3], 
Fiacco  [9],  and  Fiacco  and  McCormick  [11].  In  [2]  the  optimal  value 
function  is  shown,  under  strong  conditions,  to  be  twice  continuously 
differentiable,  with  respect  to  the  problem  parameters,  with  its 
parameter  gradient  (Hessian)  equal  to  the  gradient  (Hessian)  of  the 
Lagrangian  of  the  problem.  Armacost  and  Fiacco  [1]  have  also  obtained 
first-  and  second-order  expressions  for  changes  in  the  optimal  value 
function  as  a  function  of  right-hand  side  perturbations. 

A  number  of  results  relating  to  the  differential  stability  of 
the  optimal  value  function  have  also  been  obtained,  generally  associ¬ 
ated  with  the  existence  of  directional  derivatives  or  bounds  on  the 
directional  derivative  limit  quotient.  Danskin  [6,7]  provided  one  of 
the  earliest  characterizations  of  the  differential  stability  of  the 
optimal  value  function  of  a  mathematical  program.  Addressing  the 
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problem  minimize  f(x,e)  subject  to  xt.S,  S  some  topologicaJ.  space, 
e  in  E  ,  Danskln  derived  conditions  under  which  the  directional  de¬ 
rivative  of  f*  exists  and  also  determined  its  representation.  This 
result  has  wide  applicability  in  the  sense  that  the  const!  aint  space, 

S,  can  be  any  compact  topological  space.  Howevei ,  the  result  is  re¬ 
stricted  to  a  constraint  set  that  does  not  vary  with  the  parameter 
e.  For  the  special  case  in  which  S  is  defined  by  inequalities  in¬ 
volving  a  parameter,  g^(x,e)  0  for  i  =  l,.,.,ra,  where  f  is  convex 

and  the  are  concave  on  S,  Hogan  [15]  has  given  conditions  that  imply 
that  the  directional  derivative  of  f*  existf  and  is  finite  in  all 
directions. 

For  programs  without  equality  constraints,  Rockafellar  [19]  has 
shown  that,  under  certain  second-order  conditions,  the  optimal  value 
function  satisfies  a  stability  of  degree  two.  Under  this  stability 
property,  bounds  on  the  directional  derivative  of  f*  can  be  derived. 

For  convex  programming  problems,  Gol* stein  [16]  has  shown  that  a  saddle 
point  condition  is  satisfied  by  the  directional  derivative  of  f*. 

Gauvin  and  Toile  [13],  not  assuming  convexity,  but  limiting  their 
analysis  to  right-hand  side  perturbations,  extended  the  work  of 
Gol’ stein  and  provide  sharp  upper  and  lower  bounds  on  the  directional 
derivative  limit  quotient  of  f*,  assuming  the  Mangasarian-Fromovitz 
constraint  qualif ication  and  without  requiring  the  existence  of 
second-order  conditions.  Optimal  value  sensitivity  results  for  infinite 
dimensional  programs  have  recently  been  obtained  by  Maurer  [17,18]. 

The  purpose  of  this  paper  is  to  refine  and  continue  the  preliminary 
but  incomplete  study  conducted  by  Fiacco  and  Kutzler  [10]  that  extends 
the  results  of  Gauvin  and  Toile  [13]  to  the  general  inequality  constrained 
mathematical  program  in  which  a  parameter  appears  arbitrarily  in  the 
constraints  and  the  objective  function.  We  complete  this  extension  and 
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obtain,  for  the  general  inequality-equality  pioblen.,  the  Guuvin-Tolle 
upper  and  lower  bounds  on  the  directional  derivative  limit  quotient  of 
the  optimal  value  function.  In  a  paper  essentially  simultaneous  to  [10], 
Cauvin  and  Dubeau  [12]  have  independently  obtained  the  differential 
bounds  under  the  same  assumptions  invoked  here  but  using  a  different 
method  of  proof. 

Sections  1  through  3,  through  Theorem  3.7,  and  Sections  3  and  6  are 
taken  more  or  less  intact  from  [10]  and  are  reported  here  for  completeness. 
Theorem  s.l  and  Corollary  4.2  were  also  obtained  in  [10].  The  remaining 
results.  Lemmas  3.8,  3.10,  4.3,  4.4  and  Theorems  3.9,  3.11,  4.6,  4.8,  and 
4.9,  extend  the  reduction  approach  introduced  in  [10]  and  complete  the 
development  of  the  theory  for  the  general  inequality-equality  constrained 
parametric  problem. 


2 .  Notation  and  Definitions 

In  this  paper  we  shall  be  concerned  with  mathematical  programs 
of  the  form: 


min^  f(x,e) 

s.t.  g^(x,e)  1  0  (i=l , . . . ,m) ,  hj(x,e)  —  0  (j=l * • • • >p) » 

where  xeEil  is  the  vector  of  decision  variables,  e  is  a  parameter  vector 
in  Ek,  and  the  functions  f,  and  h^  are  once  continuously  differen¬ 
tiable  on  En  x  Ek.  The  feasible  region  of  problem  P(e)  will  be  denoted 
R(e)  and  the  set  of  solutions  S(e) .  The  m-V-Ctor  whose  components 
are  gi(x,e),  i  =  l,...,m,  and  the  p-vector  whose  components  are 
h j(x,c),  J  =  will  be  denoted  by  g(x,c)  and  h(x,e),  respec¬ 

tively. 

Following  usual  conventions  the  gradient,  with  respect  to  x,  of 
a  once  differentiable  real-valued  function  f:EnxE^E^  is  denoted 
V  f(x,e)  and  is  taken  to  be  the  row  vector  [of (x,e) . . . , 3f (x,e)/3xnl 
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If  g(*c,e)  is  a  vector-valued  function,  g: EnxE^-^Em,  whose  components 

g4 (x,e)  are  differentiable  in  x,  then  V  g(x,e)  denotes  the  m  x  n  Jacobian 
i  x 

matrix  of  g  whose  ith  row  is  given  by  V^g^x.t),  i  =  The  trans¬ 

pose  of  the  Jacobian  V  g(x,e)  will  be  denoted  V'g(x,e).  Differentiation 
with  respect  to  the  vector  e  is  denoted  in  a  completely  analogous  fashion 
Transposition  of  vectors  and  matrices  is  denoted  by  a  prime, 

The  Lagrangian  for  P(e)  will  be  written 

m  d 

L(x, p,u), e)  «  f (x, e)  -  ^  P^Cx,?:)  +  2^  Wjhj(x,e), 

and  the  set  of  Kuhn-Tucker  vectors  corresponding  to  the  decision  vec¬ 
tor  x  will  be  given  by 

K(x,k)  =  { (u,a))cEmxEP:VxL(x,y,oj,e)  =  0,  p.  >  0,  Pjg^x.e)  =  0,  i=l . m} 

Writing  a  solution  vector  as  a  function  of  the  parameter  e ,  the  index 
set  for  inequality  constraints  which  are  binding  at  a  solution  x(c)  is 
denoted  by  B(e)  =  {i : g^(x(e) , e)  -  0},  Finally,  the  optimal  value 
function  will  be  defined  as 

f*(e)  =  min  {f (x,e) :xeR(e) } . 

Throughout  this  paper  we  shall  make  use  of  the  well  known 
Mangasarian-Fromovitz  Constraint  Qualification  (MFCQ)  which  holds  at 
a  point  xcR(e)  if: 

i)  there  exists  a  vector  yxEn  such  that 

Vxgi^X,0  y  >  0  for  i  Such  that  gi(x,c)  *  0  and  (2.1) 

Vxhj(x,e)  y  ■  0  for  j«lf...,p;  and 
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ii)  the  gradients  V  h.(x,e),  j«=l,...,p,  arc  linearlj 

*  J 

independent . 

We  will  have  occasion  to  make  use  of  various  continuity  properties 
for  both  real-valued  functions  and  point-to-set  maps.  There  are  several 
related  definitions  of  the  indicated  properties.  The  ones  most  suited 
to  ou;  purpose  follow.  The  reader  interested  Jn  more  detail  is  referred 
to  Berge  [5]  and  Hogan  [16]. 

Definition  2.1.  Let  (j)  be  a  real-valued  function  defined  on  the  space  X. 

i)  <(>  is  said  to  be  lower  semicontinuous  (lsc)  at  a  point  x  £X  if 

o 

lim  <f)  (x)  >_  <J)  (x  ) . 
x~*x 

o 

ii)  cf)  is  said  to  be  upper  semicontinuoas  (use)  at  a  point  xq£X  if 

lim  (J)  (x)  £  <j>  (x  )  . 
x*x 

o 

Using  these  definitions,  one  readily  sees  that  a  real-valued 
function  is  continuous  at  a  point  if  and  only  if  it  is  both  upper 
and  lower  semi-continuous  at  that  point. 

Definition  2.2.  Let  4>:X-*Y  be  a  point-to-set  mapping  and  let  {e^}  CX, 

with  c  ->€  in  X  as  n-*». 
n 

i)  <p  is  said  to  be  open  at  a  point  e  of  X  if,  for  each  xe$(e), 

there  exists  a  value  n  and  a  sequence  {x  }  C  Y  with  x  Cd>(e  ) 

o  n  n  n  r  n 

for  n  >  n  and  x  -*x. 

—  o  n 

ii)  <f>  is  said  to  be  closed  at  a  point  £  of  X  if  x  £<J>(e  )  and  x  -*x 

n  n  n 

together  imply  that  x£<f>(£). 
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Defiriitxon  2.3.  A  point-to-set  mapping  <J>:X>Y  is  said  to  bo  uniformly 

compact  near  a  point  £  of  X  if  the  closure  of  the  set  is  com- 

e  in  N(c) 


pact  for  some  neighborhood  N(g)  of  e. 


In  Section  3  we  apply  a  reduction  of  variables  technique  to  P(c) 
which  transforms  that  program  to  a  locally  equivalent  program  involving 
only  inequality  constraints.  This  approach  simplifies  the  derivation 
of  intermediate  results  which  are  needed  to  derive  the  bounds  on  the 
directional  derivative  limit  quotients  of  f*(e)  given  in  Section  4. 

A  demonstration  of  the  results  is  provided  in  the  example  of  Section  5. 
Section  6  concludes  with  a  few  remarks  concerning  related  results. 


3 .  Reduction  of  Variables 

In  P(e),  if  the  rank  of  the  Jacobian,  V_^h,  with  respect  to  x  of 
the  (first  n)  equality  constraints  in  a  neighborhood  of  a  solution  is 
equal  to  n,  then  the  given  solution  is  completely  determined  as  a 
solution  of  the  system  of  equations  h^(x,e)  =  0,  j  =  l,...,n,  and  the 
(locally  unique)  solution,  x(e) ,  of  this  system  near  £  =  0  is  then 
completely  characterized  by  the  usual  implicit  function  theorem.  We  are 
here  interested  in  the  less  structured  situation  and  hence  assume  that 
the  rank  of  V^h  is  less  than  n.  Since  we  shall  be  making  use  of  MFCQ, 
this  entails  the  assumption  that  the  number  p  of  equality  constraints  is 
less  than  n.  If  there  are  no  equality  constraints  in  a  particular  for¬ 
mulation  of  P(e) ,  simply  suppress  reference  to  h  in  the  following  devel¬ 
opment.  Otherwise,  we  take  advantage  of  the  linear  independence  assump¬ 
tion  to  eliminate  the  equalities,  again  using  an  implicit  function 
theorem . 
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Let  x  *  (x^jX^.),  where  xD£EP  and  x^£En  P.  Reordering  variables  if 

necessary,  if  h(x*,£*)  =  0  and  MFCQ  holds  at  x*,  then  we  may  assume  that 

V  h  is  ncnsingular  at  (x*,£*).  Then  the  usual  implicit  function  theo- 
XD  n_  k 

rem  results  hold:  there  exists  an  open  set  N*  C  En  PxE  containing 

(x*,£*)  such  that  the  system  of  equations  h(x^,x^,£)  =  0  can  be  solved 
for  Xp  in  terms  of  x^  and  £  for  any  (x^,e)  in  N*.  Furthermore,  this 
representation  is  unique,  the  resulting  function  =  x^(x^,£)  is  contin¬ 
uous,  and  x*  =  xD(x*,e*).  Thus,  in  N*,  the  system  h(x^,Xj,£)  =  0  is 
satisfied  identically  by  the  function  x^  =  x^(x^.,£).  Under  our  addi¬ 
tional  assumption  that  h  is  once  continuously  differentiable  in  and 
£ »  xD(x^,£)  is  also  once  continuously  differentiable  in  Xj  and  £. 

Applying  this  result  to  P(£)  at  x*,  since  we  have  h(x^.,£)  = 
h[xD(Xj.  ,£)  f  Xj  ,£]  =  0  in  N*,  this  problem  can  be  reduced  locally  to  one 
involving  only  inequality  constraints: 

minx  hxj.e) 

s.t.  gi(xI,e)  >  0  P(c) 

and  (Xj,£) £  N*, 

where  fCx^e)  1  f  [x^Xj.e)  ,x].,e]  and  g^Xj.e)  =  .x^e]  for 

i=l,...,ir,  and  where  the  minimization  is  now  performed  over  the  n-p  di¬ 
mensional  vector  Xj.  The  programs  P  and  P  are  locally  equivalent,  for 
(x,l)  in  a  neighborhood  T*  of  (x*,0)  and  for  (x^,e)  in  N*,  in  the  sense 
that  the  point  x(c)£En,  with  (x(e),£)  in  T*  and  x(£)  =  (xD(e) ,x  (e) ) , 
satisfies  the  Karush-Kuhn-Tucker  first-order  necessary  conditions  for  an 
optimum  of  P(c)  if  and  only  if  the  point  x^(e),  with  (x^ (e) ,£)  £  N*, 
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satisf  ies  those  conditions  for  P(>-),  where  x.  (x..  ,£)  is  as  given  above. 
Furthermore,  in  the  given  neighborhoods,  x(£)  -  (x^(Xj (C) ,x^(£) )  is  a 
local  solution  of  P(£)  if  and  only  if  x^(£)  is  a  local  solution  of  P(£). 

We  first  observe  that  the  Mangasarian-Fromovitz  constraint  qualifi¬ 
cation  for  P  (£)  is  inherited  by  the  reduced  problem  P(£).  For  simplic¬ 
ity  in  notation,  and  without  loss  of  generality,  assume  that  £*  =  0,  and 
assume  that  the  components  of  x  have  been  relabeled  so  that  x  =  (x^,x^) 
and  h(x*,x*,0)  is  nonsingular.  The  next  result  is  easily  obtained  by 
invoking  MFCQ  at  (x,£)  =  (x*,0),  partitioning  the  MFCQ  vector  y  = 
in  conformance  with  x*  =  (x*,x*),  differentiating  h  and  g  with  respect  to 
Xj,  and  applying  the  assumptions.  Corresponding  to  the  notation  for  P(£), 
we  denote  the  feasible  region,  solution  set  and  optimal  value  of  P(£)  by 
R(£),  S^£)  and  f*(e),  respectively.  Other  corresponding  problem  constit¬ 
uents  will  be  similarly  denoted. 

Lemma  3.1.  If  g,h£c\  then  MFCQ  holds  at  x*eR(0),  the  feasible  region  of 
P(0),  with  y  =  (yD»Yj)  £  E*1  the  associated  vector,  where  y^  e  Ep  and 
y^ £  En  P,  if  and  only  if  MFCQ  holds  at  the  point  x* £  R(0) ,  the  feasible 
region  of  P(0),  with  vector  y^. 

Proof.  Suppose  that  MFCQ  holds  for  P(0)  at  (x*,0)  =  (x^,x*,0)  with 
y  =  (y  fy  )  the  associated  vector.  Writing  V  h  as  fv  h:V  hi  ,  we 

D  1  x  l  ^  XI  J 

see  that  (2.2)  can  be  expressed  as: 

Vx  h(x\0)  y  +  V  h(x*,0)  =  0.  (3.1) 

XD  I  1 
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Substituting  this  last  expression  in  (3.4)  we  have: 


=  Vx8i 


_[^x^h(xD(xI  »°)»xi»0)]_1  Vx  h(xD(Xj.,0)  .Xj.O) 

I 


and  from  (3.2)  we  see  that  at  (x*,0) 


v  g.  yT  =  v  g. 
Xj  i  J I  x  i 


=  Vi  yI’ 


(3.5) 


Thus,  ly  (2.1)  it  follows  that  g;^  y^  >  0. 

In  [13],  Gauvin  and  Tolle  established  that  the  set  of  Kuhn- 

* 

Tucker  multipliers  associated  with  a  solution,  x  ,  of  P(0)  is  non- 

* 

empty,  compact  and  convex  if  and  only  if  MFCQ  is  satisfied  at  x  . 

That  result  enables  us  to  establish  in  Theorem  3.2,  a  necessary  link 
between  a  directional  derivative,  with  respect  to  the  decision  vari¬ 
able  Xj,  of  the  objective  function  at  an  optimal  point  and  a  direc¬ 
tional  derivative  of  the  Lagrangian  taken  with  respect  to  the  parameter 
e.  It  is  this  relationship  which  eventually  leads  to  the  upper  and 
lower  bounds  on  the  directional  derivative  limit  quotients  which  are 
derived  in  the  next  section. 

We  now  obtain  several  perturbation  results  for  problem  P(c).  These 
do  not  depend  on  the  variable-reduction  derivation  of  P(e)  and  are  ap¬ 
plicable  to  any  inequality  constrained  problem  having  the  indicated 
structure.  Hence,  unless  otherwise  stipulated,  we  assume  in  the  follow¬ 
ing  that  a  problem  of  form  P(e)  is  given,  without  reference  to  P(e). 

The  next  two  theorems  are  crucial  in  obtaining  the  sharp  bounds  on 
the  optimal  value  directional  derivative  limit  quotient.  They  show  that, 
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at  a  local  minimum  where  MFCQ  holds,  there  exists  n  direction  (in  E*1  P) 
in  which  the  directional  derivative  of  the  objective  function  yields 
that  portion  of  the  bound  attributable  to  the  constraint  perturbation. 

Theorem  3.2*  If  the  conditions  of  MFCQ  are  satisfied  for  some 
x^eS^O)*  then,  for  any  direction  zcE^t  there  exists  a  vector  ycEn  P 
satisfying: 

i)  -Vg1(xi,0)  y  i  V^g^(x^ ,0)z  for  icB(O) ,  and  (3.6) 

ii)  Vf(Xj,0)  y  -  max  [~m' ,0)z  ] .  (3.7) 

pcK(x  tO) 

ir 

Proof.  Given  zeE  ,  consider  the  following  linear  program: 

max  Hi'V  g(x  ,0)zJ 
V*  I 

s.t.  y’Vgd^.O)  =  Vf^.O) 
pi®i^I*0)  =  0 

>  o  (i=l, . . .  ,m)  . 

The  dual  of  this  program  is  given  by: 

min  Vf(x  ,0)  y 

y.v 

s.t.  7gi(xI>0)  y  +  g±(x  ,0)vi  _>  -  V^g^(.x^  ,0)z  (i«=l, . . .  ,m) 

yeEn  unrestricted. 
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Since  MFCQ  is  assumed  to  hold  at  (x^O),  from  [13]  we  have  that 
i3  nonempty,  compact  and  convex.  Thus,  the  primal  problem 
is  bounded  and  feasible.  By  the  duality  theorem  of  linear  pro¬ 
gramming,  the  dual  program  has  a  solution,  (v,v),  and  hence  there 
exists  a  vector  y  satisfying  (3.6)  and  (3.7). 

In  the  next  two  theorems  we  show  first  that,  along  any  ray  ema¬ 
nating  from  e  =  0,  P(t)  has  points  of  feasibility  near  e  -  0,  and 
second,  that  the  existence  of  feasible  points  is  guaranteed  not  only 
along  ravs  but  in  a  full  neighborhood  of  L  *  0  .  In  obtaining  the  fol¬ 
lowing  results  associated  with  Problem  it  is  assumed  that  the 

analysis  is  confined  to  (x^,e)  in  N*. 

—  k. 

Theorem  3. 3.  If  MFCQ  holds  at  XjCS(O)  then,  for  any  unit  vector  zCE 

and  any  6  >  0,  g(x^  +  8(y  +  6yl),3z)  >  0  for  B  positive  and  sufficiently 
near  zero,  where  y  is  any  vector  satisfying  (3.6)  and  y^  satisfies  MFCQ. 

k 

Proof .  Let  z  be  any  unit  vector  in  F  and  consider  first  the  case 
in  which  the  constraint  0  is  binding  at  (x^,0).  Expanding 

gj(X|  + P (y +  Sy i ) , 3z)  about  the  point  (x^,0)  we  obtain: 

g^Xj  +  B(y  +  <Sy, )  ,Bz)  =  3  vx8i(^i  +  +  )  .3z)  (y  +  *y  ( ) 


+  B  Vf  g^x  pt'Bz)  z 


B  I  Vxgi(xJ  +t6(y+ <5>yj)  ,Bi;)y  +  V(  g^  (xj ,  t '  Bz)  *  ] 


12 


T-435 


Now,  by  (2.1),  V^g^(x^,0)y^  =  a.  :>  0.  Thus,  there  exists  3*  >  0 
such  that  for  all  3*  |G,3'1, 


3a  . 

Vxg±  (XI  +  t e ( y-t-6y  x ) ,  Hz ) y x  >  - . 

From  (3.6)  it  follows  that  for  8  sufficiently  small, 

6  a . 

V^g.  (>c  i  +  t3(y+<5yI),gz)y  +  V£gi  (Xj  .t '  3z)z  > - . 

Thus,  for  3  positive  and  near  zero  we  have: 

/  6a. \  /3a.\  3<*>a. 

gjCxj  +  gCy+Sy^.gz)  >  3^ - -g-J  +  36^— --)  =  — —  >  0  . 


Finally,  if  g^(x^,0)  >  0,  since  each  g.  is  jointly  continuous  in 
x  and  l,  i  v.  foLLows  that,  for  any  unit  vector  z*:E  ,  and  any  6  >  0, 
g.(Xj  F  i  (y-F(Sy  |  ) ,  3z )  n  for  i  near  zero. 

Theorem  3.4.  If  MFCQ  is  satisfied  at  x  rS(U)  and  if  f^-^0,  then,  given 

any  <S  >  0,  there  exists  3  ►  0  and  a  vector  y  such  that 

J 

g(xt  +  3k  (y+^Yr),  f  )  >  0  for  large  j,  where  {r  }  C{ck),  ~ 

i  j  Kj  J 

||»‘k  |  |  ,  *  >  z ,  y  satisfies  (3.6)  for  z-z,  and  y^  is  given  by 

j  3  j 

MFCQ. 

PrtH)f.  If  ft  k  1  C{t  }  and  >  k  0  lor  every  j,  the  conclusion  follows 
I  j 

for  kk  \  and  any  y  by  taking  3k  =  0  for  every  j.  Suppose  f<k  /0  for 

i  J  kj 

/  ||t  ||.  Then,  relabeling 

J 

z.  if  necessary,  we  can  assume  there  exists  z  such  that  z,  >  z .  Let 

ki  kj 

satisfy  (3.6)  for  the  vector  z.  Then,  from  Theorem  3.3  and  the  continu¬ 
ity  of  g  it  follows  that  g(Xj  +  3k  (y +  ^ j  >  *rk  ) 

i  J 

R(x,  +  3k  (y+'^Vj),  3k  zk  )  >  0  for  large  j. 

i  i  i 
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every  j.  Define  3, 


I  K  I  I  and  z  =  f 
j  “j  R 


* 


I 


By  Theorem  3.4,  the  satisfaction  of  the  Mangasarian-Fromovitz  constraint 
qualification  at  a  solution  point  x^.  of  P(0)  is  enough  to  guarantee 
the  existence  of  fe;  sible  points  for  P(c)  near  x  .  One  might  suspect 
that  there  exist  points  feasible  to  P(e)  which  are  also  feasible  to 
P(0).  This  is  indeed  the  case  as  the  next  theorem  implies  (see  the 
statement  immediately  following  the  proof  of  Theorem  3.3).  We  shall 
need  Theorem  3.5  in  obtaining  one  of  the  key  results  in  Theorem  4.3. 

Theoren  3.5.  Let  +  0+  in  e\  let  z  be  any  unit  vector  in  E^,  and 
let  6  >  0.  If  xJVKOJ  z),  with  x^  x^cRCO),  and  if  the  conditions  of 
MFCQ  are  satisfied  at  Xp  then  4-  g^(y  +  6yj)cB(0)  for  n  sufficiently 
large,  where  y  satisfies  (3.6)  with  z  replaced  by  -z,  and  y^  is  given 
by  the  constraint  qualification. 
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rroof  .  Consider  fiist  the  case  that  itlf(O).  E  .ruling  (x”  +  3n(y  ^  ' y  j )  ,0) 
about  the  point  we  obtain: 


sp*"  +  ^n(y  *  yp,0)  =  g^v^z)  +  ^vgpxj  + 


t£n(y  f  5y1),0)(y+  iyL> 


-  P 


2  .  IX  4 
”  1  I 


*n(y  +  <Syp a '  nz)z. 


who  if  t.t’t  (0,1),  t  -  L(i;  ),  t'  --  t’(c.  )•  ,f,  ft*’  n  lnr^e. 

n  n 

x‘|l  +  3n(y  +  'V  ,  since  is  feasible  for  P(r^z),  it  r.ust 

he  that 


V*IUI 


t  r  ( v 

ti 


V  j ) » 0 )  (  y  +  6y  j ) 


/  n 
gi(>:i 


* .  (y  +  <$y.  ) ,  t  \  z)z. 

r.  1  n 


(3.8) 


Dividing  by  8^  in  (3  10)  and  taking  the  limit  as  n  ►  oo  we  have 

VgjCXpOHv  +  6y T )  <  Veg,(x  ,0)z. 

Hut  this  contradicts  (3.6)  with  z  replaced  bv  -z  fi  (3.6),  ^irice  A  0 

ni. I  h'  Ni  C()  .  .  1  x  |  ,0 ;  y  j  0  . 

If,  on  the  o  the  .*  hand.  i^B(O)  ,  ^(x"  +  ?n(y4  ‘^^,0)  >  0  for 
large  n  by  the  continuity  of  and  the  fact  that  end  ►  0. 

It  nay  be  interesting  to  note,  that  by  taking  x^  =  -I  8n(y  +  ^) 
for  each  n  in  the  hypothesis  of  Theorem  3.3,  then  Theorems 
3.  V  and  3.3  together  imply  that  R(0  and  K(0)  have  points  in  common 
for  t  near  0. 

L»*t  1  tu  i  <  losed  subset  of  N*  whose  interior  contains  (x*,0)  and 
iji  note  by  f*  0  )  tlie  Problem  P(t),  where  N*  is  replaced  by  M.  The  feasible 
region  ol  V  (  )  will  be  denoted  by  R(c),  the  solution  set  by  SO  ),  the 
..pt  ini, 1 1  value  *»v  f < »  ),  etc.  Denote  by  the  interior  of  M. 
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We  now  show  that  the  optimal  value  functions  f*(t)  and  f*(0  of 
1*0)  and  P(e),  respectively,  are  continuous  near  t  =  0  unde  *  the  given 
assumptions.  This  is  proved  by  the  author  under  more  general  assumptions 
[8],  the  details  being  repeated  here  to  make  this  paper  complete.  This 
result  will  be  needed  in  the  proof  of  Theorem  4.5.  The  continuity  of 
f*(e)  was  also  shown  by  Cauvin  and  Dubeau  [12],  under  the  same  assump¬ 
tions  es  those  given  here. 

Lemma  3.6.  If  R(0)  is  nonempty  and  R(e)  is  uniformly  compact  for  £  near 
zero,  then  R(g)  is  a  closed  mapping  at  £  =  0. 

Proof.  Let  ^  4  0  in  E^,  and  (for  n  sufficiently  large),  let  x^GRfe^). 

Thus,  for  n  sufficiently  large,  g(x^,£^)  ^  0  and  (x^,£n)£M.  By  the  uni- 

n 

form  compactness  of  R(c),  there  exists  a  convergent  subsequence  {x^}  of 
n . 

(xj.)  with  +  Xj  for  some  x^.  in  the  closure  of  UR(£)  for  C  near  0. 

n . 

But  by  the  continuity  of  g,  we  must  have  0  <  lim  g(XjJ,£  )  =  g(x^,0), 

j-*30  _nj 

and  of  course  (x^,0)cM.  Thus  x^eR(O)  and  we  have  that  R(£)  is  closed  at 
£  -  0 . 

Theorem  3.7.  If  R(0)  is  nonempty,  R(c)  is  uniformly  compact  for  £  near 
zero,  and  if  there  exists  Xj.£S(0)  such  that  (Xj,0)clM^  and  the  conditions 
of  MKCQ  liold  at  x^,  then  f*(£)  is  continuous  at  £  =■  0. 

k  ^  . 

Proof.  Let  £  +  0  in  E  be  such  that  lim  f*(e)  =  lim  r*(£  ).  Clearly, 

n  e-K)  n+0  _n 

since  R(e  )  ^  $  for  n  sufficiently  large  (Theorem  3.4),  S(c  )  ^  <J)  for 
n  v 

large  n.  Hence,  assuming  n  is  large  enough,  there  exists  x^'eSO;^).  By 

the  uniform  compactness  of  R(e),  the  sequence  {x^ }  admits  a  convergent 
n . 

subsequence  {x^  }.  Let  x^  denote  the  limit  of  tha*  subsequence.  From 
Lemma  3.b,  ii(i)  is  a  closed  mapping  at  c-0,  so  x^tR(O).  Thus, 
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11m  f*(c)  =  llm  f*(e  )  =  lim  f(x  J,c  )  =  f(x  ,0)  >  f*(0), 

C-+0  "j  j-*00  "j 

and  we  see  that  f*(£)  is  lsc  at  e  =  0. 

Now  let  6  >  0,  l*it  y^.  be  given  by  MFCQ  for  x^,  and  select  +  0  such 

that  lim  f*(e)  -  lim  f*(e  ).  From  Theorem  3.4  we  know  6  +0  and  y 
e-K)  n^00  n  nj 

such  that  (y  +  5y^)e:R(£n  )  for  j  large,  where  y  satisfies 

nj  j 

(3.6)  for  some  vector  z.  Hence, 


lim  f*(e)  =  lim  f*(e  )  <  lira  f(xT  +  g  (y+6yT),e  )  =  f(x,0)  =  f*(0) . 

e*>  en  -*0  nj  =  j-  1  nj  1  nj 

J 


Thus  f*(^)  is  also  use  at  e  =  0  and  we  may  conclude  that  f*^£)  is  con¬ 
tinuous  at  C  =  0. 

We  should  mention  that  the  continuity  of  f*  requires  only  the  con¬ 
tinuity  of  f  in  addition  to  the  once  (joint)  continuous  differentiabil¬ 
ity  of  the  constraints. 

The  continuity  of  f*(e)  at  £  =  0  leads  to  a  simple  proof  of  the 
continuity  of  f*(e),  the  optimal  value  of  P(e).  This  is  of  intrinsic 
interest  and  will  also  be  used  in  deriving  the  directional  derivative 
limit  quotient  lower  bound  in  the  sequel.  We  first  note  the  following 
result,  the  first  part  being  an  easy  consequence  of  the  continuity  of 
the  problem  functions  that  is  proved  precisely  analogously  to  Lemma  3.6. 
The  proof  that  f*(e)  is  lsc  at  e  =  0  precisely  parallels  the  first  part 
of  the  proof  of  Theorem  3.7  that  shows  that  f*(c)  is  lsc. 


Lemma  3.8*  If  R(0)  is  nonempty  and  R(e)  is  uniformly  compact  for 
£  near  0,  then  R(e)  is  a  closed  mapping  and  f*(e)  is  lsc  at  c  *  0. 
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Theorem  3.9.  If  R(0)  is  nonempty,  R(e)  is  uniformly  compact  for  £  near 
0,  and  if  MFCQ  holds  at  some  x*CS(0),  then  f*(t)  Is  continuous  at  C  =  0. 

Proof.  We  eliminate  the  equalities  of  P(e)  at  >;*  for  (x^,e*  in  a  neigh-  ■ 

borhood  N*  of  (x*,0).  where  x*  =  (x*,x*),  using  the  previously  defined  1 

variable  reduction  transformation,  constructing  problems  of  the  form  j 

P(e)  and  P(£).  We  know  that  x*ES(0)  and  that  MFCO  holds  at  x*  (Lemma 
3.1).  Also,  the  uniform  compactness  of  R(e)  near  £  =  0  implies  the 
uniform  compactness  cf  R(c)  near  e  =  0. 

Clearly,  f*(e)  <  f*(£)  <  f*(e)  and  since  f*(0)  =  f(x*,0)  =  f(x*,0),  ! 

we  conclude  that  f*(C)  =  f*(0)  =  f*(0),  which  also  implies  that  x*£S(0).  i 

The  assumptions  of  Theorem  3.7  are  satisfied,  hence  f*(c)  is  continuous  J 

1 

at  0.  These  relationships  imply  that  lim_  -  f*(e)  <  lim  _  f*(£)  * 

t'H)  --  E-H)  * 

f*(0)  =  f*(0);  i.e.,  f*(e)  is  use  at  0.  Since  f*(e)  is  also  lsc  at  e  = 

0  (Lemma  3.8  ),  the  conclusion  follows.  ’ 


A.  Bounds  on  the  Parametric  Variation  of  the  Optimal  Value  Function 
In  this  section  we  are  concerned  with  the  directional  derivative 
of  the  optimal  value  function  for  P(e).  We  first  derive  upper  and 

-  JL 

lower  bounds  on  the  directional  derivative  limit  quotient  of  f  (e) 

for  P(c)  and  then  obtain  the  corresponding  bounds  for  P(e).  These 

results  extend  the  work  of  Gauvin  and  Tolle  [13],  who  obtained  the 

analogous  results  for  the  case  in  which  the  perturbation  is  restricted 

to  the  right-hand  side  of  the  constraints. 

As  above,  we  will,  without  loss  of  generality,  focus  attention 

k 

on  the  parameter  value  e  *=  0.  For  zeE  ,  the  directional  derivative 
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of  f*(e)  at  e  =  0  in  the  direction  z  is  defined  to  be: 

D  f*(0)  -  lim  , 

Z  f3>0+  6 


(4.1) 


providing  that  the  limit  exists. 


Theorem  4.1.  If,  for  P(e),  MFCQ  holds  for  some  x^eS(O),  then,  for 


any  direction  zeE  , 


lim  sup 
6+0+ 


f*(gz)  -  f*(0) 


<  max  V  L(x_  ,p,0)z. 

"  .  sr,-  £  i 


(A. 2) 


yeK(xI ,0) 


Proof.  Let  B  satisfy  the  conditions  of  Theorem  3.3,  let  6  >  0 
andy^be  the  vector  given  by  the  constraint  qualification,  and 
let  y  satisfy  eqs.  (3.6)  and  (3.7).  Then,  for  any  zeE  , 

Xj  +  3(y  +  6yI)e^(Bz)  for  3  near  0,  so  that 


lim  sup 


f*(3z)-f*(0)  .  ..  f(xI+3(y+6y1),gz)  -  f(xIf0)  dj 

5 -  <  lim^  sup  - — - 5 - =  -^(Xj.O) 


=  Vf(xI,0)(y  +  6yr)  +  V£f(xI,0)z. 


Since  this  inequality  is  satisfied  for  arbitrary  6  >  0  we  can 
take  the  limit  as  6  ■+  0  and  obtain: 

lim+  sup  f*(gz->  Z-tlQl  <  Vf(xr,0)y  +  V^^.Oz. 


The  conclusion  now  follows  by  applying  (3.7): 
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f*CRz’)  -  f*(0)  -  -  - 

lim  -sup  — u  ax  1-p'V.gfx  ,0)  +  V  f(x  0)]z 

tK)  P  p£K(x*,0)  '  l 

=  max  V  L(x  ,p,0)z. 

U£K(x*,0) 

Corollary  4.2.  Under  the  hypotheses  of  the  previous  theorem,  if  MFCQ 
holds  at  each  point  Xj£S(0),  then 

lira  sup  f*-(gz)-~.  fHQ>  <  inf  max  V  L(x  ,y,0)z .  (4.3) 

g-H)  P  XjCS (0)  p£K(Xl,0)  1 

Proof.  The  result  follows  directly  by  applying  the  previous  theorem  at 
each  point  of  S(0). 

To  obtain  a  lower  bound  on  the  directional  derivative  limit  quo¬ 
tient  ,  we  use  MFCQ  and  the  following  result  which  is  well  known  and  fol¬ 
lows  easily  from  the  results  obtained  in  the  last  section. 

Lemma  4,3.  If  R(0)  ^  0,  R(£)  is  uniformly  compact  near  £  =  0,  and  f*(£) 
is  continuous  at  £  =  0,  then  S(£)  is  closed  at  £  =  0. 

Proof.  Suppose  £^  +  0  as  n  -►  00  and  suppose  x^£S(£n>  is  such  that 

XI  XI*  Lemma  3.6,  R(e)  is  closed  at  e  =  0,  so  x*eR(0).  Since 

f*(e)  is  continuous  at  e  =  0,  it  follows  that  lim  f*(c  )  =  lim  f(x^,£  )  s 

n  n^»  1  n 

f(x*,0)  -  f*(0),  hence  x*£S(0). 

The  next  lemma  is  an  immediate  consequence  of  this  result  and 
Theorem  3.7. 
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j.emina  4.4.  Suppose  ■>  0  and  the  assumptions  of  Theorem  3.7  hold. 

Then,  for  n  large,  there  exists  and  all  limit  points  of  {x^} 

are  in  S(G). 

Proof.  The  fact  that  S(e)  ^  0  for  near  0  follows  from  the  fact  that 
R(e^)  f  <J)  (Theorem  3.4)  and  compact  for  n  large  (since  R(e)  is  uniformly 
compact  for  £  near  0)  and  since  f(x^,e^)  is  continuous  in  N*.  From 
Theorem  3.7,  we  know  that  f*(£)  is  continuous  at  £  =  0.  The  conclusion 
then  follows  from  the  previous  lemma. 


Definition  4.5.  For  any  given  vector  zeE  ,  an  infimal  sequence  x ^  of 

the  directional  derivative  limit  quotient  of  f*(e)  is  defined  as  {x^} 

such  that  x?£S(3  z)  and 
I  n 


llm  inf  -  hSSl 

6-K)+  P 


f(x"  B  z)  -  f(x*  0) 
lim  - 1  ■  ■  a - - - 


Theorem  4.6.  Suppose  z  is  any  given  vector  in  E  .  Suppose  the  assump¬ 
tions  of  Theorem  3.7  are  satisfied  and  suppose  that  is  a  limit  point 
of  an  infimal  sequence  {x^}  as  defined  in  Definition  4.5,  relative  to  the 
given  vector  z.  Then, 

lim  inf  Z  >  _min  V  l  (x  ,M,0)z.  (4.4) 

B-H)+  C  yeK(xI,C) 

Proof.  Let  6  0  .  We  already  know  from  Lemma  4.3  that  there  exists 

-  n 

x^eS(3nz)  for  n  large,  and  all  limit  points  of  {x^}  are  in  S(0).  Also, 
by  definition,  an  infimal  sequence  as  defined  above  always  exists  and 
there  must  exist  at  least  one  limit  point  in  S(0)  of  this  sequence. 
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Relabeling  if  necessary,  our  assumptions  allow  us  to  conclude  a  bit  more, 
i.e.,  that  x^  Xj.£S(0)nN*,  where  {x^}  is  an  infimal  sequence  relative 
to  the  given  vector  z. 

Since  MFCQ  holds  at  x^.,  Theorem  3.3  assures  that  x^  +  3n(y+<5y^.)eR(0) 
for  n  sufficiently  large.  It  follows  that 


11.  Inf  -  M  ,  li»  t<’‘l,B°Z>  ~  f<1’0) 

g-K)+  tv*00  n 


>  lim 


f(Xj,3nz)  -  f  (x"+ Bn(y+5yI)  ,0) 


=  lim  [— Vf  (a  )  (y+'Sy  )  +  V  f(ct  )z] 
n-~  n  I  e  n 

by  the  mean  value  theorem,  where  is  the  usual  convex  combination  (in 
En  P  x  E^)  of  the  two  arguments  in  the  preceding  quotient.  Thus, 

lim  inf  £-*(gz)  ~0  f*(-^  >  lim  vj(cx  )z  -  Vf(ct  )(y+6yT) 

3-0+  0  ~  n-»  e  n  n  1 

=  Vef(x].,0)z  -  Vf(xI,0)(y+6yi). 

Using  Theorem  3.2  and  noting  that  6  was  chosen  as  any  positive  value,  we 
conclude  that 


lim  inf  ft  f*^— -  >  V  f(x  ,0)z  -  max  [y'7  g(x T,0)z] 

3-0+  0  yeKtXj.O) 


min  V  L(x  ,y,0)z. 

yeic^.O) 


Corollary  4.7.  Under  the  hypotheses  of  the  previous  theorem 


lim  inf  -  inf  min  V  L(x  ,y,0)z.  (4.5) 

e-0+  *  x];eS(0)  yeK(xI,0) 
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By  the  reduction  of  variables  that  was  applied  earliej ,  in  a  neigh¬ 
borhood  of  (x*,0),  with  x  =  (xD(xJ.  ,e)  ,x^.) , 

L(x,u,u>,e)  =  f(x,e)  -  u'gCx,^)  +  a)'h(x,e) 

~  ^  (XD^X1,£^  C)  “  ^  8  (x  j  ,  C  )  5  X^  ,  C  )  +  GJ  h  ( x^  (x^. ,  6  )  ,  X  j  ,  G ) 

=  f(xI,e)  -  M,g(xI,e)  -  L(xI,u,e), 

with  f(x,e)  =  f(xI,e)  ,  g(x,e)  =  g(xI>e),  and  h(x,e)  =  hUj.,^)  =  0.  Thus 

L(x,M,u),g)  =  LCx^jUjG)  in  a  neighborhood  of  (xD(x*,0) ,x*,0)  *  (x*,0)  and, 

with  uj  determined  by  oo *  =  -(V  f  -  y'V  g)[V  h}  \  it  follows  easily 

XD  XD  XD 

that  V^L  =  V^L  and  the  linear  program  appearing  in  the  proof  of  Theorem 
3. 2  and  involved  in  the  preceding  bounds  can  readily  be  formulated  analo¬ 
gously  as  a  locally  equivalent  problem  in  terms  of  L(x,p,u),£) . 

We  now  utilize  the  above  results  obtained  for  P(£)  and  P(£)  to  ob¬ 
tain  bounds  for  the  optimal  value  directional  derivative  quotient  of  P(e). 

k 

Theorem  4.8.  If  MFCQ  holds  at  some  x*eS(0),  then  for  any  direction  zeE  , 

lim  sup  —  — Z--q — -  ^  <  max  V  L(x*,p ,w,0)z 

6-0+  6  "  (y,<u)eK(x*,o)  £ 

Proof.  Apply  the  variable  reduction  transformation  at  x*  =  (x*,x*) 

as  in  the  previous  construction  to  obtain  a  problem  of  the  form  P(e), 

defined  for  <Xj.,e)  in  a  neighborhood  N*  of  (x*,0).  Since  f*(e)  £ 

f*(e)  and  f*(0)  =  f*(0),  we  have  that 

,  .  f*(3z)  -  f*(0)  .  ,  .  f*(Bz)  -  f*(0) 

3-+0+  P  '■  3-K)+  “ 

and  the  conclusion  is  an  immediate  consequence  of  Theorem  4.1,  having 

expressed  the  bound  in  (4.2)  in  terms  of  the  original  variables  by  way 

of  the  variable  reduction  transformation. 
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Theorem  4.9.  If  R(0)  f  <j>,  R(£)  is  uniformly  compact  near  £  =  0,  and 

p 

MFCQ  holds  for  each  xeS(O),  then  for  any  direction  zeE  \ 

lim  inf  —  ^  ■  r> — —  >  min  V  L(x*,y,w,0)z 

3-*0+  P  '  (y,to)eK(x*,0) 

holds  for  some  x*eS(0). 


Proof.  Given  any  zeEn,  consider  xne  S(^z)  such  that 

lim  inf  **■«*>■  -  f*<°>  =  lim 

3~H)+  n-*°°  n 

Since  R(c)  is  uniformly  compact,  there  exists  a  subsequence,  which  we 

again  denote  by  {x11},  and  a  vector  x*  such  that  x^  -►  x*.  By  Lemma  3.8, 

R(c)  is  closed  and,  by  Theorem  3.9,  f*(e)  is  continuous  at  £  *  0.  It 

follows  (as  in  the  proof  of  Lemma  4.3)  that  S (c)  is  closed  at  0,  so 

x*cS(0) . 


We  now  apply  the  variable  reduction  transformation  at  x*  = 
(x*,x*),  following  the  usual  construction,  and  obtain  a  problem  of  the 
form  P(£),  defined  for  (x^e)  in  a  neighborhood  N*  of  (x*,0).  We  also 
define  the  reduced  problem  P(e),  i.e.,  problem  P(e)  with  M,  a  closed 
subset  of  N*  whose  interior  contains  (x*,0),  replacing  N*. 

Noting  that  in  N*,  f*($nz)  =  f*(3^z)  and  f*(0)  -  f*(0),  it  is 
easily  verified  that  the  assumptions  of  Theorem  4.6  are  satisfied  and 
we  also  have 

a.  i„f  r  f*w  -  u.  inf  hmij-hssi' 

3-K)+  e  £-+0+  6 

from  which  the  conclusion  follows,  expressing  the  right  hand  side  of 
(4.4)  in  terms  of  the  original  variables  via  the  variable  reduction 
transformation. 
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Clearly  Corollaries  4.2  and  4.7  immediately  extend  to  f*(*c)  as 
well,  using  these  results.  Thus,  all  of  the  results  obtained  above  for 
P(e)  and  P(e)  can  be  immediately  generalized  to  P(e).  For  completeness, 
we  state  these  results  as  the  next  theorem. 

Theorem  4.10.  If,  for  P(e),  R(0)  is  nonempty  and  MFCQ  holds  at  each 

ic 

xeS(O),  then  for  any  unit  vector  zcE  , 

lim  sup  — - ^  <  inf  max  V  L(x,y,co,0)z,  (4.6) 

g-*0+  P  xeS(O)  (M,oo)eK(x,0) 

and  if  R(e)  is  uniformly  compact  for  e  near  c  =  0,  then 

lim  inf  - - i  inf  min  VrL(x,u,w,0) z .  (4.7) 

6>0+  **  xcS(O)  (p,u)eK(x,0)  C 

Moreover,  we  are  able  to  obtain  the  existence  of  the  directional 
derivative  of  f*  at  e  ~  0  by  assuming,  as  Gauvin  and  Tolle  [13]  did 
for  right-hand  side  programs,  the  linear  independence  of  the  binding 
constraint  gradients  at  each  point  x*cS(0), 

Corollary  4.13.  Assume  R(0)  is  nonempty  and  R(e)  is  uniformly  compact 
near  c  -  0  If  the  gradients,  taken  with  respect  to  x,  of  the  con¬ 
straints  binding  at  x*  are  linearly  independent  for  each  x*eS(0), 

k  4 

then  for  any  unit  vector  zeE  ,  (0)  exists  and  is  given  by 

D  f*(0)  =  inf  V  L(x,ti(x)  ,u)(x)  ,0)z, 

Z  xcS(O)  e 

where  (u(x) ,w(x))  is  the  unique  multiplier  vector  associated  with  x. 
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Proof,  At  any  point  x*eS(0)»  the  linear  independence  of  the  binding 
constraint  gradients  implies  the  uniqueness  of  the  Kuhn-Tucker  multi¬ 
pliers  corresponding  to  x*.  Inequalities  (4,6)  and  (4.7)  now  combine 
to  yield  the  desired  result. 

Note  that  in  Corollary  4.n  if  P(e)  contains  no  inequality  con¬ 
straints,  we  could  replace  inf  by  min  since  p  would  not  appear  and 

u)f  *  -V  f  V  h  1  which  is  continuous  in  making  V  L z  a  continuous 

*D  *D 

function  of  x  minimized  over  S(0),  a  compact  set. 

We  may  also  show  that  two  of  the  observations  made  by  Gauvfn  and 

Tolle  [13]  about  Dzf*(0)  for  right-hand  side  programs  apply  to  P(e) 
as  well.  First  if  Dzf*(0)  =  -  D_zf*(0),  then 

inf  max  V  L(x,y,O),0)z  =  sup  min  V  L(x,p,io,0)z.  (4.8) 

xeS(O)  (p,w)eK(x,0)  xcS(O)  (p,a)  eK(x%  0) 

Thus,  if,  for  all  unit  vectors  zce\  D  fx(0)  =  -  D  f  (0)  and 

Z  -2 

D  f*(0)  -  inf  max  V  L(x,U,u),0)z ,  (4.9) 

Z  xeS(O)  (p,w) eK(x,0) 

then  (4.8)  provides  a  necessary  condition  for  the  existence  of  V  f*(0). 

k  x 

In  addition,  if  (4.8)  holds  for  every  unit  vector  zlE  and  if  x  eS(0) 
is  the  unique  solution  of  P(0),  then  its  associated  Kuhn-Tucker  multi¬ 
plier  vector  is  unique. 

We  next  apply  the  results  derived  above  to  a  particular  class 
of  programs.  We  show  in  the  next  theorem  that  if  P(e)  is  a  convex 
program  in  x  for  e  near  e  -  0,  i.e.,  if  f(x,e)  and  -g.(x,c). 
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i-l,...,m,  are  convex  and  if  hj(x,£),  j=l,...,p,  are  affine  in  x,  then 
D  f*(0)  exists  and  is  given  by  (4.9).  To  prove  this  result,  we  will  re¬ 
strict  our  attention  to  convex  programs  of  the  form  P(£),  with  (x^,£)  no 
longer  constrained  to  be  in  a  specified  neighborhood  N*.  We  ace  able  to 
do  this  since  the  functions  h^(x,£)  are  assumed  to  be  affine  in  x  and 
f(x)  and  the  -g^(x,£)  are  taken  to  be  convex  in  x,  from  which  it  easily 
follows  that  the  variable  reduction  transformation  applies  globally,  and 
further,  f  (xT  ,e)  and  the  -g^x^e)  are  convex  in  x^  for  i=l,...,m. 

Theorem  4.12.  In  P(e),  let  f(x,e)  and  -g^Xje),  i  =  l,...,m  be  con¬ 
vex  and  let  hj(x,e),  j  =  l,...,p  be  affine  in  x.  If  R(0)  is  non¬ 
empty,  R(e)  is  uniformly  compact  near  e  ~  0,  and  MFCQ  holds  for  each 

j. 

x‘cS(0),  then,  for  any  unit  vector  zcE  , 

D  f*(0)  «  inf  max  V  L(x,m,(jO,0)z  .  (4.10) 

2  xeS(O)  (p,ui)eK(x,0)  e 


Proof.  Without  loss  of  generality,  as  indicated,  we  will  prove  this  re¬ 
sult  for  P(e),  with  the  set  N*  not  present.  For  convenience,  the  nota¬ 
tion  is  somewhat  simplified  by  dropping  the  subscript  I  in  the  argument. 
Note  that  the  assumptions  imply  that  R(e)  =  (x | g^(x,e) ^ 0,  is 

a  convex  uniformly  compact  set  near  £  =  0. 

Let  x*£S(0)  and  x  £S(S  z)  with  3  0+  in  such  a  way  that 

v  n  n  7  n  J 


lim  inf 
3>0+ 


f*(By)  -  f*(0)  „  ~  i(*  -0) 

6  "  K 


> 


and  x  ■>  x*  as  in  the  proof  of  Theorem  4.9.  For  all  p*r.K(x*,0), 


-  27  - 


1-435 


28 


T-4  35 


from  which  we  see  that 

llm  inf  - -(gZ--R~-  >  inf  max  V  Ux,p,0)z. 

3 >-0+  h  xeS'(O)  weK(x*,0)  * 

Combining  this  result  with  that  obtained  in  Corollary  4.2  we  conclude 
that 

D  f*(0)  -  inf  max  V  L(x,M,0)z. 

2  xc?(0)  peK(x,0)  C 

For  convex  P(c) t  (4.10)  now  follows  by  an  inversion  of  the  reduction 
of  variables  process  applied  to  yield  P(c). 

5 .  Example 

We  use  the  example  stated  below  to  demonstrate  some  of  the  theoret¬ 
ical  results  obtained  in  the  previous  sections.  For  the  given  problem 
we  show  that  the  conditions  of  MFCQ  hold  at  every  point  in  S(c)  and  we 
give  the  form  of  the  vector  satisfying  the  constraint  qualification.  We 
obtain  the  form  of  the  vector  satisfying  (2.1)  and  (2.2)  for  P(e),  and 
show  that  the  bounds  stated  in  (4.6)  and  (4.7)  are  attained. 

Consider  the  program 

min  tx^  P(0 

s.t.  g(x,c)  =  -  (Xj-e)2  -  (x2~2)2  +  4  _>  0 
h(x, i )  =  -  x^  +  x2  +  e  ■  0. 

The  solution  of  this  program  is  easily  determined  to  De  x*  =  x*  +  t  with 
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x*  ®  |°  C>®  ,  and  if  e  =  0,  x*  can  be  any  value  in  the  interval  [0,2].  (5.1) 

2  (2  e<0  2 

Applying  the  reduction  of  variables  technique  outlined  earlier,  with 
and  Xj  =  x2,  P(e)  is  transformed  into  the  equivalent  program 

min  e(x2+e)  P(e) 

s.t.  <g'(x2,e)  «  -  Xj  -  (x2-2)2  +  4^0 

whose  solution  is  given  by  (5.1). 

For  both  P(e)  and  P(c),  the  optimal  value  function  can  be  written 
as 

!e^  e  0 

.  •  (5.2) 

e^+2e  e  <  0 

We  see  that  f*  is  continuous  for  all  values  of  e,  but  it  is  not  differ¬ 
entiable  at  c  =  0.  It  does,  however,  have  directional  derivatives  at 
c  =  0  which  are  given  by 


(0  2  =  1 

D  f*(0)  -  .  (5.3) 

2  (-2  z  =  -1 

To  illustrate  Lemma  3.1,  we  first  determine  the  general  form 
of  the  vector,  y,  associated  with  points  xtS(e)  at  which  MKCQ  is 
satisfied.  The  constraint  gradients  of  P(e)  are 

Vg (x,e)  =  [-2(x1-c),  -2(x2-2)],  and 
Vh(x, e)  =  [— 1,1 ) . 
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a 


Applying  (2.1)  and  (2.2)  at  a  point  x*  =  (x^x^eSU) ,  with  y  = 

(y 1 , y 2 ) >  we  require  that  Vg(x*,£)y  =  -2(x*-t)y^  -  2(x*-2)y,  >  0  if 

g(x*,0)  =  0,  and 

Vh(x*,e)  y  =  -y^  +  y2  =  0. 

Thus,  for  any  value  of  e,  since  g(x,e)  is  binding  only  if  x*  =  0,: 
y  can  hav3  the  form 

(a, a)  x*  =  0 

(b,b)  0  <  x*  <  2  ,  ( 

(c,c)  x*  =  2 

for  any  real  numbers  a,b,c  with  a  >  0,  b  ^  0,  and  c  <  0.  We 

can  also  conclude  that  MFCQ  holds  at  every  solution  of  P(e). 

In  a  similar  fashion,  we  see  that,  for  P(e), 

Vg(x2,e)  =  -2x2  -  2(x2~2), 

so  applying  (2.1)  we  find  that  the  vector  y^  in  the  reduced 
program  takes  the  same  form  as  the  second  component  of  y  in  (j.4) 

Now 

VI.(x,p ,h>,c)  =  [e  +  2p(x^-e)  -  w,  2p(x2-2)  +  u], 

so  that  at  a  solution  x*lS(0)  we  must  have  2px^  -  <j  -  0  for 

(p,w)cK(x*,0) .  Then 
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VtL(x*,y =  x*  , 

2 

and,  with  S(0)  =  {xeE  :  x^=x2 ,  x2c[0,2]}, 

0  z  =  1 

rain  max  V  L(x,U,u>,0)z  =  .  (5.5) 

xeS(O)  (m,uj)  cK(x, 0)  -2  z  =  -1 

Comparing  (5.3)  with  (5.5)  we  see  that  (4.6)  holds  with  equality. 

Now,  considering  inequality  (4.7),  we  first  note  that  for  any 

neighborhood  N(0)  of  OcE^,  the  closure  of  the  set 
2 

{xeE  :  x  =  (x2+t,  x2),  x2e[0,2],  c  in  N(0)}  is  compact  so  R(c)  is 
uniformly  compact  for  c  near  e  =  0.  We  calculate 

0  z  =  1 

min  min  V  L(x,y,u),0)z  =  , 

xeS(O)  (p,m)eK(x,0)  |-2  z  =  -1 

and  find  that  (4.7)  also  holds  with  equality. 

The  above  results  could  have  been  anticipated  from  (4.10),  since 
the  conditions  of  Theorem  4.12  hold  for  this  example. 

An  example  is  given  in  [13]  which  illustrates  that  (4.6)  and 
(4.7)  need  not  hold  with  equality. 

6 .  Related  Results 

Inspection  of  the  derivation  of  (4.6)  and  (4.7)  reveals  that  the 
bounding  term  in  these  expressions,  namely  VcL(x, m,co,0)z  ,  can  be 
viewed  as  the  sum  of  two  distinct  expressions,  one  resulting  from  the 
variation  of  the  objective  function  of  P(c)  with  respect  to  the 
parameter,  the  other  deriving  from  the  dependence  of  the  region  of 
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feasibility  on  the  parameter.  The  first  of  these  terms  is  Vcf(x,0)z 
and  is  easily  seen  to  result  directly  from  the  manipulation  of  the 
limit  quotients  in  the  proofs  of  Theorems  4.1  and  4.6.  The  second 
component,  [-yf  V^g(x,0)  +  a)’  VMi(x,e)  ]z ,  results  ftom  the  assumption  that 
MFCQ  holds  at  points  of  S(0).  The  conditions  of  MFCQ  are  invoked  to 
enable  us  to  conclude  (3.7),  as  well  as  the  existence  of 
points  feasible  to  P(e)  in  a  neighborhood  of  e  -  0.  Having  made 
these  observations,  we  are  now  able  to  discuss  the  relationships 
between  the  bounds  provided  here  and  results  previously  obtained  by 
others.  As  we  shall  see,  in  particular  instances  in  which  the  direc¬ 
tional  derivative  of  f*  is  shown  to  exist,  it  is  expressed  as  either 
a  function  of  V^f  or  a  function  of  V^g  and  V^h,  or  a  combination  of 
all  of  these  terras,  depending,  as  one  would  suspect,  on  where  in 
P(e)  the  parameter  appears. 

Danskin  [6,7]  provided  a  now  well-known  characterization  of  the 
directional  derivative  of  the  optimal  value  function  of  P(e)  in  the 
case  that  the  constraints  are  independent  of  a  parameter.  Under  the 
conditions  that  the  region  of  feasibility,  R(0),  is  compact,  and 
f(x,t)  and  V^f(x,e)  are  continuous  at  e  “  0,  Danskin  showed  that 

D  f * (0)  =  min  V  f(x,0)z.  (6.1) 

Z  xeS(O)  E 

Relating  our  hypotheses  to  Danskin* s  construct,  we  first  note  the 
equivalence  of  our  assumption  of  the  uniform  compactness  of  R(e)  for 
v  near  e  =  0,  and  the  assumption  that  the  feasible  region  is  compact 
if  the  constraints  of  P(e)  do  not  depend  on  c .  To  see  this,  one  need 
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only  consider  that,  in  this  case,  R(f )  -  R(0)  for  all  e  end  apply 
Definition  2.3.  In  addition,  when  the  feasible  region  is  independent 
of  e,  our  development  need  not  consider  the  perturbed  point 
x*  +  &(y  +  Sy) ,  but  may  be  restricted  to  the  point  x*tS(C).  The  proofs 
of  Corollaries  4.2  and  4.7  remain  valid  in  this  case  by  simply 
suppressing  all  reference  to  the  dependence  of  the  constraints  on  s 
and  by  considering  the  unperturbed  point  x*  instead  of  x*  +  ft(y  +  &y) . 
One  is  then  led  to  conclude  that,  analogous  to  (4.6)  and  (4.7), 


lim  sup  ~  - -  -----  <•  min  7  j:(x,0)z,  and  (6.2) 

6^0+  P  xeS(O)  b 

lim  inf  >  min  V  f(x,0)z,  (6.3) 

6>0+  *  xeS(O) 

for  any  unit  vector  zcE  .  Thus  it  follows  that,  under  the  stated 
conditions,  namely  the  compactness  of  R  and  the  continuity  of  f(x,e) 
and  V^f(x,e)  at  e  =  0,  our  results  are  consistent  with  those  of 
Danskin  in  that  they  verify  the  existence  of  D^f^CO)  and  show  (from 
(6.2)  and  (6.3))  that  it  can  be  expressed  as  in  (6.1). 

Gauvin  aad  Tolle  [13]  showed,  for  programs  with  right-hand  side 
perturbations,  i.e.,  for  programs  of  the  form 


min  f (x) 

s.t.  &1<x)  _>  ( i— 1 , .  . .  ,m) , 

hj(x)  =  (j=l,...,p). 


P’(e) 


A 

that  although  the  directional  derivative  oi  f  may  not  exist,  its 
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only  consider  that,  in  this  case,  R(c)  --  R(0)  for  all  e  end  apply 
Definition  2.3.  In  addition,  when  the  feasible  region  is  independent 
of  e,  our  development  need  not  consider  the  perturbed  point 
x*  +  g(y  +  6yQ  ,  but  may  be  restricted  to  the  point  x*tS(C).  The  proofs 
of  Corollaries  4.2  and  4.7  remain  valid  in  this  case  by  simply 
suppressing  all  reference  to  the  dependence  of  the  constraints  on  s 
and  by  considering  the  unperturbed  point  x*  instead  of  x*  +  £(y  +  Sy) . 
One  is  then  led  to  conclude  that,  analogous  to  (4.6)  and  (4.7), 


lim  sup  -  ^  _<  min  V  f(x,0)z,  and  (6.2) 

**  xeS(O) 

^  a 

lim  inf  LISsL^lJ-SSL  >  min  V  f(x,0)z,  (6.3) 

BK)+  6  xeS(O) 

k 

for  any  unit  vector  zeE  .  Thus  it  follows  that,  under  the  stated 
conditions,  namely  the  compactness  of  R  and  the  continuity  of  f(x,e) 
and  V^f(x,e;)  at  e  =  0,  our  results  are  consistent  with  those  of 
Danskin  in  that  they  verify  the  existence  of  Dzf*(0)  and  show  (from 
(6.2)  and  (6.3))  that  it  can  be  expressed  as  in  (6.1). 

Gauvin  and  Tolle  [13]  showed,  for  programs  with  right-hand  side 
perturbations,  i.e.,  for  programs  of  the  form 


min  f(x) 

s.t.  gj.(x)  >_  ei 

hjU)  =  Emfj  • • »P>  > 


P’(e) 


that  although  the  directional  derivative  of  f*  may  not  exist,  its 
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limit  quotient  can  be  bounded*  In  particular,  they  concluded  that 
if  MFCQ  holds  at  each  element  of  S(0)  and  if  R(e)  is  uniformly  compact 


for  e  near  e  *  0,  the  following  inequalities  are  satisfied: 


lim  sup 


t*W  -  f*<0>  <  inf 

P  xeS(O) 


max 

(vi,u)eK(x,0) 


).  (6.4) 


and 


lim  inf 
B^0+ 


f*(Bz)  -  f*(0) 
6 


>_  inf 
xeS(O) 


min 

(li,w)  eK(x, 0) 


Now,  from  (4.6)  and  (4.7)  we  see  that  the  bounds  we  have  given  for 
the  general  program  P(r)  reduce  to  those  in  (6.4)  and  (6.5)  respec¬ 
tively  for  the  more  restrictive  perturbations  appearing  in  Pf(c). 

In  the  case  of  convex  programs,  the  existence  of  Dzf*(0)  assured 
by  Theorem  4.12  and  its  expression  as  (4.10),  corresponds  under 
slightly  different  assumptions,  with  results  achieved  by  Gol* stein 
[14]  and  Hogan  1 15].  Theorem  4.12  is  a  direct  extension  to  the  general 
perturbed  mathematical  program  of  a  result  given  by  Gauvin  and  Tolle 
[13]  for  right-hand  side  programs. 

A.  Auslender  [4]  has  extended  the  results  of  Gauvin  and  Tolle 
fl3]  to  problems  involving  non-dif ferentiable  functions.  In 
particular,  the  bounds  noted  by  (6.4)  and  (6.5)  are  obtained  for 
right-hand  side  programs  in  which  the  problem  functions  are  locally 
Lipschitz  and  those  defining  the  equality  constraints  are  continuously 
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Subsequent  to  the  completion  of  this  paper,  it  came  to  our  attention 
that  Geraud  Fontanie  ["Locally  Lipschitz  Functions  and  Nondif ferent iable 
Programming,"  M.S.  Thesis,  Technical  Report  80-3,  Curriculum  in  opera¬ 
tions  Research  and  Systems  Analysis,  University  of  North  Carolina  at 
Chapel  Hill,  1980]  extended  the  Gauvin-Tolle  bounds  [13]  to  a  generally 
perturbed  Lipschitz  program,  using  the  reduction  technique  described 
here. 
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